Cooperation and Flexibility in Multimodal Communication
نویسنده
چکیده
The design of cooperative dialog systems, new human-computer interfaces (cf. Schomacher et al 1995) and avatars in various types of virtual environments can all be improved by better knowledge of features of real human-human multimodal communication. In this paper I discuss the nature of cooperation in dialog. I will also discuss what might be called features of flexibility and conflict prevention and how they are related to cooperation. I will illustrate the features of flexibility and conflict prevention by examples drawing on videorecorded and transcribed human-human dialog. The main focus will be on nonverbal gestural means, since verbal means are somewhat better known. The paper is intended to illustrate how new ideas about the design of dialog systems (cf Pandzic et al 1996, 1997) will also lead to an interest in aspects of human-human communication that have received less attention so far.
منابع مشابه
Achieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملFlexibility, Communication and Cooperation with Imperfect Monitoring
Flexibility – the possibility to react swiftly to others’ choices – facilitates cooperation by reducing the gains from defection. With imperfect monitoring, however, flexibility may also hinder cooperation by inducing punishment after too few noisy signals. In theory, the interplay of these forces should generate an inverse U-shaped effect of flexibility on cooperation. To test this subtle pred...
متن کاملMultimodal Interaction: Methods and Applications for Joint Cooperation between Humans and Cognitive Systems
In this paper, we present an overview on recent advances in our work on multimodal human-machine communication between humans and technical cognitive systems in order to enable the solution of complex problems that require the joint cooperation of humans and intelligent systems to accomplish challenging tasks that can be only successfully handled if both interact in a cooperative manner. The te...
متن کاملMultimodal Interaction Techniques for Joint Cooperation Between Humans and Cognitive Systems
In this paper, we present an overview on recent advances in our work on multimodal human-machine communication between humans and technical cognitive systems in order to enable the solution of complex problems that require the joint cooperation of humans and intelligent systems to accomplish challenging tasks that can be only successfully handled if both interact in a cooperative manner. The te...
متن کاملOn the Annotation of Multimodal Behavior and Computation of Cooperation Between Modalities
With the success of multimedia and mobile devices, humancomputer interfaces combining several communication modalities such as speech and gesture may lead to more "natural" humancomputer interaction. Yet, developing multimodal interfaces requires an understanding (and thus the observation and analysis) of human multimodal behavior. In the field of annotation of multimodal corpus, there is no st...
متن کامل